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characters in the scene in an intermediate tome color picture and 
the detail of the shadow clear. 

CONSTITUTION: Each color signal decomposing a color picture 
signal is fed in parallel with signal adder sections 12D14. a minimum 
value detecting section 7 and an edge detection section 8 from 
input terminals 4D6. A black color signal of a minimum density of 
each digital color signal is calculated by the detection section 7 and 
the result is added to the detection section 8 and a black level 
detection section 9. The detection section 9 calculates the black 
density level proportional to the density of the black color signal 
and the level is fed to function converting sections 1 0. 11 together 
with the output of the detections section 8. Then an output of a 
converting section 10 is fed to the adder sections 12D13. where the 
said output is added to each color signal, an output of the 
converting section 1 1 and the black quantity from the detection 
section 7 are added by a signal adder section 1 5 so as to make 
characters in different color in the intermediate color picture and 
the detailed part of the shadow part clear, thereby preventing color 
mis-alignment. 
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4. SPACE Method 

10 Fig. 4 is a block diagram of image segregation with SPACE 

(Segmentation by Peak and Continuous Edge Method) that we propose herein. 

As illustrated in Fig. 4, the image segregation can be roughly divided 
into two processes: one is detection of screen dot area, and the other is 
detection of edge area. In addition, as a result of overall determination of 

15 these two processes, it is determined whether an area is a text or picture 
(screened halftone, photographs). Table 1 illustrates correspondence 
between results of detections by the two processes and the overall 
determination. 

20 Table 1 : Overall Determination 
Detection of Screen Dot Area 
Detection of Edge Area 
Overall Determination 

25 Text 
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Anything other than the above combinations 
Picture (Screened halftone, photographs) 

5 [ T] represents a detected area, and [x] represents an undetected area. 

4.1 Detection of Screen Dot Area 

This method of detecting screen dot area is designed to improve the 

problem of conventional art, namely, low precision level of segregating text and 
10 colored screened halftone. 

Fig. 5 illustrates density changes in monochrome and colored screen 

dot areas read by a monochrome scanner. This reveals that a number of 

conical crests (troughs) exist in the monochrome screen dot area. It is also 

found that there still remains uneven crest (trough) like information in the 
15 colored screen dot areas, although shapes of cones are collapsed. In 

contrast, unlike in the screen dot area, the ridges continue at certain height In 

the text area. 

The method of detecting screen dot areas utilizes this characteristic to 
segregate screened halftones from others. In other words, it is detected that 

20 picture elements that correspond to peak and bottom of screened halftones 
(hereafter referred to as peak-pixels) in a localized area, then detect a block 
where peak-pixels are dense (S). and further correct detection results of the 
block area (S) based on block information on surrounding blocks. Fig. 6 is a 
block diagram of detecting screen dot areas, and details of respective steps 

25 are discussed below: 
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(1) Detection of peak-pixels: Peal^-pixels are to be detected through 
operations. To be specific, in a block of 3 x 3 as shown in Fig. 7, 

(A) Density level (L) of a center pixel is higher or lower than that of all 
5 surrounding pixels; and 

(B) L and density level (a. b) of 4 pairs of diagonally located pixels across the 
center pixel are in the following relation: 

|2 X L - a - b| >TH 
where TH is a fixed threshold. 
10 When (A) and (B) are simultaneously satisfied, the center pixel is considered a 
peak-pixel. 

(2) Detection of screen dot areas: 

In 4 blocks, each consisting of 4 x 4 pixels as illustrated in Fig. 8, when more 
than 1 block contains a peak-pixel, it is determined that a reference block as a 
15 screen dot candidate area and other blocks as non-screen dot candidate area. 

Taking into consideration that screen dots of more than 100 lines are to 
be detected as screen dot areas, such parameters are set as a block size, etc. 

(3) Correction of screen dot areas 

Utilizing results of the screen dot area detection described above, 
20 screen dot areas are corrected. Specifically, as illustrated in Fig. 9, in 9 

blocks with a reference block located centrally, if 4 or more blocks are screen 
dot candidates, the reference block is made as a screen dot area. If not, the 
reference block is made as a non-screen dot area. The correction process 
utilizes the character that a screen dot area cannot exist in isolation and does 
25 exist with certain dimensions. 



3 



4.2 Detection of Edge Area 

Text pixel data often contains pixels of high and low densities 
(hereafter referred to as black and white pixels, respectively), and in addition, 
5 has continuous black and white pixels in edges. In contrast, photographs are 
multi-valued information and take intermediate values in many parts. 

Although it is premised that screen dots are to be segregated as 
screen dot areas in the detection of screen dot areas described above, 
detection of peak-pixels is difficult in highlighted and shadow parts of screened 

10 halftones, because ups and downs of crests and troughs in Fig. 5 are not rough. 
For this reason, in the edge area detection, it is desirable that highlighted and 
shadow parts of screened halftones, in particular, are not detected as an edge. 
The highlighted and shadow parts are characterized by that respective screen 
dots are isolated, and black and white pixels are not contiguous. 

15 Keeping these in mind, edge areas based on continuity of respective 

black and white pixels are detected. Fig. 10 is a block diagram of detecting 
edge areas, and details of respective steps are discussed as follows: 

(1) Ternarization 

20 After performing edge enhancement on input image data of 64 tones, it is 
ternarized with two types of fixed thresholds (white pixels < 16/63 and black 
pixels 32/63). Fig. 11 illustrates the filter used for edge enhancement. 

(2) Detection of continuity of black/white pixels 

By pattern matching, it is detected that parts where black and white pixels after 
25 ternarization are continuous. Fig. 12 illustrates examples of patterns to be 
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used. When pixels match these patterns, a center pixel will be activated 
(hereafter referred to as black continuous pixels and white continuous pixels). 
In addition, patterns are selected by taking notice of edge of a character having 
some directionality. 
5 (3) AND part 

Since a few pixels from a boundary between text and background are detected 
as edge area, in a 5 x 5 pixel block, a reference block is made as an edge area 
if both of one or more black and white continuous pixels detected through 
pattern matching exist. If not, it is determined as a non-edge area. 

10 

4.3 Overall Determination 

In blocks of overall determination process, from results of both 
detection of screen dot areas (4.1) and detection of edge areas (4.2), 
determination is made on whether an area constitutes text or picture, according 
15 to the overall determination of Table 1 . In other words, it is determined that a 
text area Is an area judged as a non-screen dot area by the screen dot area 
detection and as edge area by the edge area detection, and that other areas 
are picture areas (screen dot area and photograph area). 

20 5. Experiments and Results 

We read various manuscript copies by a monochrome scanner of 400 
dpi and 60 tones and ran a simulation with the image segmentation algorithm 
we propose herein. Following is a report on two types of images: 

25 (A) A monochrome manuscript copy in which characters (9th grade), screen 
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dots (150 lines), and photographs are present in a mixed manner. 
(B) A colored screened halftone manuscript copy (100 lines) 
Fig. 13 illustrates original images (64 tones) on the CRT display. Size of the 
manuscript copy conventional to reading by the scanner was approximately 32 
5 mm X 32 mm. 

Fig. 14 (a) to (c) are examples of judgments obtained by executing this 
image segmentation process: (a) is results of screen dot area detection (a 
white part represents screen dot areas), (b) is results of edge area detection (a 
black part represents edge areas), and (c) is results of segmentation of 
10 text/picture areas (a black area is text, and a white area is picture). 
Furthermore, Fig. 14 (d) illustrates results of adaptive process of 
binarization/dithering, by utilizing the results of segmentation illustrated in Fig. 
14(c). 

In the results of segmentation process of Fig. 14 (a), a non-screen dot 
15 area exists in the screened halftone image (i.e., in the eyes of the woman). 
This is because this area constitutes a shadow part of screened halftones and 
thus no peak-pixel of the screened halftones has been detected. However, as 
the highlighted and shadow parts of screen dot areas are determined as 
non-edge area in the edge area detection (i.e., a white part in the screened 
20 halftone image of Fig. 14 (b)), finally they constitute picture areas, as illustrated 
in Fig. 14 (c). 

Similarly, Figs. 15 (a) to (c) are examples of judgments obtained for a 
colored screened halftone manuscript copy (100 lines). Fig. 15 (a) is results 
of the screen dot area detection (a white part represents a screen dot area), 
25 which indicates that detection of peak-pixels work well even in a colored 



screened halftone manuscript copy. Fig. 15 (b) is results of edge area 
detection (a black part represents an edge area). In a colored screen dot 
manuscript copy as well, similar to the above-mentioned monochrome screen 
dot manuscript copy, the highlighted and shadow parts are determined as 
5 non-edge area in the edge area detection. In addition, Fig. 15 (c) illustrates 
results of segmentation of text/picture areas (a black area constitutes text and 
a white area picture), from which it is found that the colored screen dot 
manuscript copy is correctly segregated as a picture. In addition. Fig. 15 (d) 
illustrates results of the adaptive process of binarization/dithering by utilizing 

10 results of segregation of Fig. 1 5 (c). 

From results of two segregation processes illustrated in Figs. 14 (c) 
and 1 5 (c), it is found that the image segmentation method could segregate 
text and picture areas with good precision. 

Figs. 16 (a) to (d) illustrate screens reproduced by respective 

15 processes: (a) is binarization, (b) dithering, (c) error diffusion process, and (d) 
adaptive process of binarization/error diffusion. 

As illustrated in Figs. 16 (a) and (b), both resolution of text and tone are 
difficult to achieve only through binarization and dithering. In contrast, in Figs. 
14 (d), adaptive processes of binarization/dithering achieve both resolution and 

20 tone. 

In addition, in order to clearly indicate how differently text is processed 
by binarization and by error diffusion, enlarged views of a Japanese character 
"jIg" is shown, which is illustrated in Figs. 16(a) and (c), and Figs. 17 (a) and (b). 
This reveals that even the process of error diffusion method could not 
25 adequately achieve both resolution and tone, and that there is still difficulty of 
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resolution, in particular. The adaptive process is effective for solving the 
problem, and the adaptively processed image (Fig. 16 (d)) by the image 
segmentation proposed herein is of higher quality than the image (Fig. 16 (c)) 
uniformly processed by the error diffusion method. 

5 

6. Conclusion 

We successfully developed SPACE, a new image segregation 
algorithm, that is a combination of the screen dot area detection utilizing peak 
information of screened halftones and the edge area detection employing 

1 0 continuity of black and white picture elements. 

As a result of applying the algorithm to image data read by a 
monochrome scanner of 400 dpi and 64 tones, it could be confirmed that text 
was segregated from pictures with great precision, and that the algorithm was 
effective in improving the image quality. In particular, the algorithm could 

15 solve the problem of the conventional art segregation method, namely, 

erroneous segregation of pictures as a text in a colored screen dot manuscript 
copy. 

In the future there still remains the problem of segregating characters 
on a screen dot (characters surrounded by screen dots). In this image 
20 segregation algorithm, characters in the proximity of screened halftones are 
determined as screened halftones because of the feature of the screen dot 
area detection, which makes it difficult for the algorithm to solve the problem. 
Hence, there is the need for studying a different approach. 
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Fig. 8 Mask for detecting screen dot area. 
\2xL-a-b\ >TH 

(2) m.^.m^^^ 08>;:5F-rJ:-J'^4x4!ffiiJ35 

(3) «g.d^M!ijE itlaivCOfil.'^.^^^tlii^^^ 
4.2 X*y5^fili«^a 



Block 



3 9 6i3.^.ffl«?iSiEffl-^;^^ 
Fig. 9 Mask for correcting screen dot area. 



Input 
I Base 



.3 
Level 



Detection of 
Continuous Black 
Pixels 



Detection of 
Continuous Vhite 
Pixels 



And 



Output 
Signal 



Output Signal : Edge / Non-Edtc 
Fig. 10 Block diagram of delecting edge area. 





0 


0 


-4 


0 


0 


1 






















— X 


-1 


-3 


24 


-3 


-1 


8 
























0 


0 


-4 


0 


0 



Fig. 11 Mask for enhancement. 
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: etc. 



' etc. 



• ; Black Pincl 0;irhite Pixel C-J ; Don't Care 

Fig. 12 Pattern of adjoining, continuous black and while 
pixels (example). 




(a) Honochroae Oricinal 
laaice 

UppeKScreened Halftone 
LoverlCoDtinuoas Tone 



(b) Color Original 
Inase of 

Screened Halftone 



913 X/7i5ft(CRT±) 
Fig. 13 Picture of image on CRT. 




Q-» ScreeQ Dot ■-♦ Jl on -Screen Dot 
(a) Result of Detect! as Screeo Dot Arcj 



(b) Result of DctecUnt Edte Are* 



9 




9 





«-» Text a-* Picture 
(c) Kesalt of Totil Determiiutioo 



(d) Reproduced luxe by Adaptive Process 
( Biaariutioo / Dither Xethed ) 



314 SIRlSC1i5;c?t'r'5^^rnt^«i:a£tSaSli(Sl 
Fig. 1-1 Result.' nf each scgmemalion and reproduced image by adaptive process for 
monochrome original image. 



43 



Ti^^^m^^yk-xm -92/1 vours-p-ii N0.1 



(1) zmit BAfsm(o\timmr-^:zjiyi^ 

(2) n. ^m^ommiSL^Hi 2mitm<omm 

(3) AND SB x^ti^^fDm^^"o»mm'^ 



4.3 U^PIA 

4.2 X y i^m^^ihoymmommi)^^. n 1 £0i^:#4^is 



ScKcii Dot Hon-Screcii Dot 

(a) Resalt ef Detectins Screen Dot Area 



Text □-♦ Pictttw 
(c) Icsolt of ToUl OeteninatioD 




Edce a-» Hoft-Bdie 
(b) Resnlt of Detectins Gdse Area 




(d) SepHKhieed iMce by Adaptive Process 
( Biurization / Dither Hetbod ) 



Fig. 13 Results .»f each sejn-.u::.t:ition and reproduced IraaRe by adaptive process for 
color orij;tnal ima«e of screened halftone. 
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0, ^iHiS3Kco»is553^»r^i^=rr-'> ^ 

(A) ( 9 ») 1 1^."^. (150 m t ¥K*>*iS«E L 

(B) 7 -IS.'iSLiil^ (100 1^) 

CfLotD CRT ^7^(0mm^ (64 fSgii) eEl 13 \Z7r^t. 
X^r -f-^^^moWM^^ XJi^ 32 mm x 32 mm r 

( b )!i y s;$5^<D3»£U^^ (^*^^ v^^iSE), ( c )ii 
^^/l^fi^^^<^^«i«m(JlA**^««. Sd^^^ 
S)Th^, MS-. [ilI4(d)ti, lll4(c)(05>gl^«*: 



9 




(a) ReprnlDccd lui* hr BinrizatiM 



•4, 

1 



V * -c. 1^ V ^ ^'JJt $ n ^> *^ (lili4( b )<om 
!^mm^<O^(0^^). iai4(c)c^-rJ:'5ic«rS^&^'3: 

nU S-EI 15( a )— ( c * 7 -Si * I^m (100 SS) 
C^^U-r, ^hiXtz^Pimm^Om-Va^^, g) 15(a) 

m!^M>^Wz o r *) fcf - @^*l£tJ 53 frr? T 
; ^ S Z t *ir>3C)»o, HI 15( b -/^^©i^iii^^ 




(b) Reproduced laaie by Dither Method 




(c) Scprodaeod Ime Iw EiTor Ufaaloi Xethod 



(d) lepndaced Ilue by Adiptin Process 
( UnariutiM / Error Difaion Xethod ) 



§116 SljfeE*'^?! 
FiK. 16 Samples of reproduced imase. 
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5S^!i5«5,^©^^aa:fi:a -92/1 VoI.J75-D-II Xo.l 




(a) Error Oifusion Hcthod (b) Binarization 
Fig. 17 Enlarged character. 



1114(c), 0 15(C), -OO^t«l45arS.^m*»o. 

m 16( a )--(<! )Ji. #5Qr»-J:6^5feiai1^^^Urv^ 
-2>, ( a )ii 2 {I<ti0r31, (b);i7">f ^-ia^. {c)itmm 

tiLWiT^iz X ^mm. ( d ){i 2 mit/mmij:ni^(omiz^ 

m 16( a )ts X rj{ b )iC^1- J: -5 IC 2 mit(0?i^h^^ >»i 

5ail©^*5J:<55'3i*^>J:-5t-, El 16(a), {c)^<DX^ 
''iMj $cjt*tT6'enen<^fi£:;'c«:S 17(a), (b)'.c^U 

fl^S 05 tc pg® ^ -5 . en ^-W^r ^> fz It tiiSi^: 

(EI16(c)) J: 0 4), ^IEIS5&(^^^5^^MS^^''^:'- 
iSjCE^aSilffe (12 16(d)) co^*>S!iliH<tli» t X 

6. C T 



A^<:>-ii-f--iTL'-^^^^iair/i'=ry XA, spacers 

^7/i-::^'UXA«:, 400 dpi, 64 PgPOfil^:^ ^ r :^ 

tfifz:z^)ii^m-r^Nimtiar>^. :^iSi^^mr>\^d' 
ir m.^, tLx mm \.xL.^ofz^z a^fAm(r>m 

2Si«gt^^, pp. 39-42. 10. 

( 2 ) : "^:^/«^>r-^3Bi§»s^s•IH^1l^ B±-f o -/ ;^ 

* 7 i * - h 2 . pp. S- 15 (1967). 

ft«<^(B>, J70-B. 2. pp. 222-232(1987-02). 

(4) : ••t:a=-3§:3ac-ia.#.epwiioa«Ero@iffli5?2a 

^\mZ'^±7^. pp. 91-94. 22. 

*5J Haa^i.. iWi^fia. HffiAfs : "f •>•^i^s»al/3:wi^ 
;t^s^l«a®ai^is::5fi&^ S2 2iB«^±^. pp. 43-46. 
11. 

f^jDiftiS^S^^jii", f3^tt«3, IE90-32 (1990-07). 

(^SK3*3 3 7aSft. 7«26a^j&l^) 
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